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EXECUTIVE  SUMMARY 


A.  BACKGROUND.  As  part  of  the  Planning.  Programming  and  Budgeting  process 
the  Arny  must  forecast  the  level  of  activity  for  its  customer  program. 
Historically,  the  amount  actually  purchased  has  often  been  less  than  the 
amount  forecasted  (in  FY  79  this  was  not  a  problem).  This  difference  causes 
several  problems,  as  discussed  in  the  report.  Previous  studies  have  tried 
to  provide  improved  forecasts,  but  used  inappropriate  techniques  or  were 
based  on  insufficient  data  bases. 

B.  STUDY  OBJECTIVES.  This  study  seeks  to  forecast  the  amount  and  timing 

of  procurement  obligations  for  the  Army's  Customer  program  (Foreign  Military 
Sales,  Military  Assistance  Program,  and  Other),  given  customer  orders  or 
other  driving  variables.  The  study  seeks  also  to  forecast  these  driving 
variables.  The  study  seeks  to  develop  an  aggregated  statistical  forecast, 
rather  than  to  provide  improved  procedures  for  estimating  individual  actions. 
Specific  objectives  are  (1)  develop  and  apply  improved  procedures  for 
forecasting  customer  obligations,  (2)  determine  the  statistical  relationship 
between  orders  and  obligations,  taking  into  account  the  timing  and  delay 
between  orders  and  obligations,  (3)  provide  confidence  intervals  as  well  as 
point  estimates  for  the  forecasts,  and  (4)  determine  the  applicability  of 
the  procedures  to  forecasting  the  Direct  Army  program. 

C.  STUDY  APPROACH.  The  authors  examined  budget  execution  policies  and 
procedures  for  the  customer  program  and  reviewed  the  literature  on  economic 
forecasting.  One  hundred  twenty-eight  pairs  of  data  points  were  collected, 
reflecting  historical  orders  and  obligations  for  each  of  the  five  procure¬ 
ment  appropriations.  Several  statistical  methods  were  evaluated,  including 
polynomial  regression,  multiple  regression,  and  exponential  smoothing.  Time 
series  methods  (both  univariate  and  transfer  function  analysis)  were  used 

to  quantify  the  relationship  between  orders  and  obligations.  Ratios  and 
factors  were  developed  to  provide  an  alternate  method  of  forecasting,  when 
an  estimate  of  year  end  orders  is  available.  An  organizational  perspective 
provided  further  insights  into  the  process. 

D.  FINDINGS,  CONCLUSIONS,  AND  RECOMMENDATIONS.  The  timing  of  orders  does 
not  drive  the  timing  of  obligations,  and  so  orders  cannot  be  used  to  pro¬ 
duce  time-phased  statistical  forecasts.  However,  the  amount  of  year-end 
orders  does  influence  the  amount  of  year-end  obligations,  and  the  obligation 
curves  are  similar  from  year  to  year.  These  facts  allow  forecasts  to  be 
made,  and  tables  are  provided  for  use  in  making  point  estimates  and  con¬ 
fidence  intervals.  Use  of  these  methods  for  the  direct  Army  program  is  not 
recommended.  Organizational  considerations  seem  to  be  influencing,  and 
possibly  dominating  the  process,  and  further  work  should  address  the  methods 
by  which  the  obligation  goal  is  set.  Other  findings,  conclusions  and 
reconmendations  are  provided  in  the  study. 


CHAPTER  I 


INTRODUCTION 


A.  BACKGROUND. 

As  part  of  the  Planning,  Programming,  and  Budgeting  process  the  Army 
must  estimate  the  amounts  and  timing  of  funds  required.  Due  to  the  budget 
schedule  the  estimated  annual  requirements  must  be  submitted  to  Congress 
18  months  before  the  beginning  of  the  fiscal  year.  It  has  been  very  diffi¬ 
cult  for  the  Army  (and  other  services)  to  develop  accurate  forecasts  this 
far  ahead.  While  the  original  forecasts  can  be  updated  as  more  data  become 
available,  the  difference  between  the  original  forecasts  and  the  amounts 
actually  purchased  has  caused  several  problems. 

Some  outside  the  Army  have  asked  whether  the  "shortfall"  reflects  an 
inability  of  the  Army  to  perform  its  programs,  GAO  (1978)  found  that  this 
was  not  the  case.  Some  in  Congress  have  asked  whether  the  unused  funds  for 
the  items  not  bought  could  be  used  elsewhere,  perhaps  to  reduce  future 
appropriations.  The  Army  (and  other  services)  usually  respond  that  the  items 
are  still  required  and  will  be  purchased  in  the  next  year  (procurement 
appropriations  are  available  for  new  obligation  for  three  years). 

The  two  examples  just  given  illustrate  criticism  from  outside  the  Army 
when  obligations  fall  below  the  forecast.  But  the  President  and  others  have 


also  objected  when  obligations  appear  unusually  high,  especially  in  the 
last  month  of  the  fiscal  year.  Forecasting  errors,  and  the  resulting  loss 
of  credibility,  have  caused  much  criticism  In  recent  years. 

Inaccurate  forecasts  can  also  cause  problems  between  different  levels 
within  the  Army.  In  a  complex  program  many  activities  have  to  be  scheduled 
to  occur  at  specific  times.  When  the  schedule  for  one  item  slips,  many 
other  items  may  be  affected.  The  uncertainty  about  schedule  makes  necessary 
a  time-consuming  dialogue  between  different  levels  about  the  amount  and 
timing  of  funds  needed  at  the  lower  level.  And  much  effort  goes  into  the 
preparation  of  reports  explaining  why  the  amount  actually  obligated  is 
different  from  the  amount  planned.  Each  level  is  under  pressure  to  justify 
its  plan,  but  no  level  has  a  precise  forecast. 

Unrealistic  forecasts  could  result  in  less  efficient  means  of  pro¬ 
curement  personnel  accomplishing  their  functions.  If  the  amount  of  funds 
obligated  by  an  individual  contracting  office  falls  behind  the  plan, 
that  office  may  feel  pressured  to  achieve  the  plan  by  emphasizing  the 
placement  of  large  dollar-amount  contracts  while  deferring  placement  of 
many  other  equally  important  but  small  contracts.  In  some  cases  a 
contract  with  a  tentative  price  (such  as  a  letter  contract)  may  be 
used  instead  of  another  more  desirable,  but  time  consuming  form.  In 
other  cases  procurement  planning.  Should  Cost  studies,  and  audits 
may  be  deferred  or  cancelled  in  order  to  place  contracts 


according  to  a  forecast  made  long  before.  In  each  of  the  examples  above, 
the  contract  may  be  for  a  valid  requirement,  but  the  timing  or  the  method 
used  was  driven  by  an  overoptlmistic  forecast. 

The  Army  has  used  two  main  approaches  to  reduce  the  problems  described 
above.  The  first  approach  is  to  make  the  budget  execution  process  more 
responsive  and  flexible  through  the  use  of  new  management  information 
systems,  word  processing  procedures,  and  the  realignment  of  organizational 
functions.  This  approach  has  been  partly  successful,  and  improvements 
continue.  The  second  approach,  used  by  this  study,  is  to  try  to  improve  the 
original  forecasts  and  thereby  begin  the  fiscal  year  with  a  more  realistic 
plan. 

The  present  forecasts  are  developed  by  the  MSC's  using  a  "bottoms-up" 
approach.  Knowledgeable  persons  at  each  MSC  estimate  the  type,  quantity, 
cost,  and  schedule  of  items  required  for  the  Army's  own  use  (the  direct  Army 
program)  and  for  those  who  buy  Army-managed  items  through  the  Army  (the 
customer  program) .  These  individual  forecasts  are  aggregated  and  become 
the  official  forecast.  In  some  cases  DARCOM,  after  coordination  with  the 
MSC,  asks  the  MSC  to  adjust  these  forecasts.  The  study  sponsor  must  manage 
both  the  direct  Army  and  the  customer  programs,  but  improved  techniques  are 
more  critically  needed  for  the  customer  program  because  it  is  more  difficult 
to  forecast.  Therefore,  this  study  analyzed  customer  forecasting. 

Chapter  II  clarifies  certain  terms  and  concepts  unique  to  the  budget 
execution  process. 
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There  are  many  events  that  can  cause  the  amounts  and  timing  to  fall 
behind  the  plan.  For  example,  sometimes  it  is  desirable  to  wait  for 
additional  customer  orders  in  order  to  achieve  a  quantity  discount  from 
the  contractor.  Legal  problems  can  delay  the  contracting  process.  Orders 
from  foreign  countries  can  be  cancelled,  as  happened  recently  in  Iran. 

On  the  other  hand,  very  few  events  can  happen  to  accelerate  the  program. 

The  Army  cannot  easily  pressure  the  State  Department  or  contractors  to 
respond  more  quickly.  It  is  difficult  to  replace  customers  who  have 
cancelled  orders.  As  a  result,  the  amounts  actually  obligated  are  usually 
much  less  than  the  amounts  forecasted. 

There  have  been  several  recent  attempts  to  develop  improved  forecasting 
methods.  Since  the  amounts  and  timing  usually  fall  behind  the  plan,  it 
would  seem  possible  to  develop  adjustment  factors,  based  on  historical 
data,  which  could  be  used  to  correct  the  traditional  forecasts.  Perry 
(1979)  used  this  approach  with  little  success.  Brannon  (1977)  used  a  multipl 
regression  approach  to  forecast  the  cumulative  amount  obligated  at  the  end 
of  the  fiscal  year  with  little  success.  Chapter  III  discusses  several 
methods  that  have  been  or  might  be  tried. 

It  appears  that  no  Army  organization  has  been  able  to  prepare  a 
precise  forecast  for  its  procurement  appropriations.  The  lack  of  an 
accurate  forecast  has  caused  problems  between  the  Army  and  others.  It 
has  also  caused  problems  within  the  Army.  While  many  studies  have  tried 


to  develop  better  forecasting  methods,  they  have  used  either  inadequate 
data  bases,  or  have  used  inappropriate  analytical  techniques.  The  Army 
still  needs  a  good  long  range  forecast  of  obligations. 

B.  STUDY  OBJECTIVES. 

This  study  seeks  to  develop  improved  procedures  for  forecasting  the 
amount  and  timing  of  customer  procurement  obligations,  given  some  variables 
such  as  customer  requests  for  pricing  data,  customer  orders,  cormhtments, 
or  time.  The  study  seeks  also  to  forecast  these  variables.  These  two 
forecasts  are  to  be  combined.  For  example,  if  one  can  forecast  orders  n 
months  ahead,  and  if  orders  can  be  related  to  obligations  with  an  average 
delay  of  m  months,  then  one  can  forecast  obligations  (n+m)  months  ahead. 

The  study  seeks  to  provide  an  independent  statistical  forecast  for  use 
by  Headquarters,  DARCOM,  rather  than  to  provide  improved  procedures  for  use 
by  MSC  s  in  estimating  individual  actions.  Such  a  parametric  forecast 
should  complement  and  not  replace  the  detailed  planning  that  will  still  be 
required  for  management  of  each  case.  Specific  objectives  of  this  study 
are  to: 

1.  Describe  and  analyze  the  customer  obligation  process. 

2.  Determine  the  relationship  between  customer  obligations  and  customer 
orders,  or  other  driving  variables,  explicitly  taking  into  account  the 
timing  and  delays  between  the  variables. 
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3.  Develop  and  apply  improved  procedures  for  forecasting  customer 
obligations,  to  include  confidence  intervals  as  well  as  point  estimates. 

4.  Determine  the  applicability  of  the  developed  procedures  to  fore¬ 
casting  the  direct  Artny  program. 

5.  Identify  any  problems  found  and  recommend  improvements  to  the  process. 

C.  SCOPE . 

This  study  addresses  the  five  customer  procurement  appropriations  (Pro¬ 
curement  of  Aircraft,  Procurement  of  Missiles,  Procurement  of  Weapons  and 
Tracked  Combat  Vehicles,  Procurement  of  Ammunition,  and  Procurement  of  Other). 
Appropriations  such  as  Research,  Development,  Test  and  Evaluation,  Military 
Construction,  and  Operations  and  Maintenance  were  not  addressed.  For  each 
of  the  five  appropriations  data  were  collected  using  the  following  breakout: 
Foreign  Military  Sales  (FMS),  Military  Assistance  Program  (MAP),  Other,  and 
Total.  These  terms  are  explained  in  Chapter  II. 

D.  STUDY  APPROACH. 

The  budget  execution  process  was  examined,  and  the  process  for  the 
customer  program  was  found  to  be  different  from  the  direct  Army  program  in 
several  ways,  including  the  identification  of  requirements,  the  control  of 
funds,  and  the  recording  of  data.  These  findings  are  summarized  in  Chapter  II. 

A  literature  review  and  interviews  showed  that  MSC's  continue  to  refine 
their  bottoms-up  approach  described  above,  and  the  authors  do  not  duplicate 
the  current  work  in  this  area.  Some  studies  have  attempted  to  compare  the 
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traditional  forecasts  of  obligations  with  the  amounts  ultimately  obligated. 
Any  percentages  developed  from  this  approach,  however,  would  have  to  be 
applied  to  an  Intrinsically  soft  figure  (the  traditional  forecast),  and 
the  result  would  necessarily  be  soft,  This  approach  was  rejected. 

Other  studies  have  compared  historical  obligation  goals  to  the  amounts 
later  obligated.  The  authors  felt  that  no  accurate  forecast  could  be  based 
on  a  study  of  such  goals.  In  fact,  some  studies  seemed  to  show  a  confusion 
between  forecasts  and  goals.  This  matter  is  clarified  in  Chapter  III. 

It  appears  that  the  obligation  process  has  always  been  treated  as  a 
statistical  or  as  a  management  information  problem.  No  study  was  found 
which  viewed  the  process  as  a  complex  system  with  many  levels  and  multiple 
(perhaps  conflicting)  goals.  A  very  brief  description  of  the  budget  execu¬ 
tion  process  from  an  organizational  perspective  was  developed. 

After  completing  the  literature  review  and  interviews,  a  list  of 
candidate  forecasting  techniques  was  compiled,  including  polynomial 
regression,  multiple  regression,  exponential  smoothing  and  others.  All 
are  evaluated  in  Chapter  III.  Box-Jenkins  time  series  analysis  (both 
univariate  and  transfer  functions)  was  selected  as  the  most  suitable  In 
the  present  context.  Time  series  analysis  is  a  forecasting  (as  opposed  to 
curve  fitting)  technique  and  explicitly  addresses  the  delays  within  the 
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system  and  the  lack  of  statistical  independence  between  consecutive  months. 
Another  approach,  called  ratio  analysis,  was  developed  for  this  study  to 
take  advantage  of  the  unusual  configuration  of  the  data  set. 

Several  variables  were  candidates  for  analysis.  The  main  variable  of 
interest  is,  of  course,  customer  obligations.  Perhaps  the  earliest  pre¬ 
cursor  of  an  obligation  is  the  customer's  initial  request  for  price  data. 
However,  some  customers  do  not  request  this  Information,  and  some  who  do 
request  it  do  not  place  orders.  If  potential  customers  were  queried  about 
their  intentions,  some  useful  Information  might  result,  but  the  use  of 
initial  “feelers"  did  not  seem  promising.  Commi tments  occur  much  closer  in 
time  to  obligations.  They  are  probably  too  close  for  use  in  long  range 
forecasting  and  are  several  steps  removed  from  the  logical  driver  of  obliga 
tions,  which  is  firm  (or  "accepted")  customer  orders.  Monthly  data  for 
customer  orders  and  customer  obligations  were  collected  and  are  recorded 
in  Appendices  A  throucih  E. 

The  data  were  analyzed  and  findings,  conclusions,  and  recommendations 
were  drawn.  But  before  describing  the  analysis  it  is  necessary  to  define 
some  budget  terminology  and  describe  the  process  by  which  customer  orders 
finally  result  in  contract  awards  resulting  in  the  obligation  of  funds. 
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CHAPTER  II 


THE  OBLIGATION  PROCESS  FOR  CUSTOMER  PROCUREMENT  FUNDS 

A.  INTRODUCTION. 

The  sale  of  military  hardware  in  the  United  States  is  controlled  by 
Congress.  Congress  will  not  permit  foreign  countries  to  buy  military 
hardware  from  American  contractors  unless  these  purchases  are  supervised 
by  the  Department  of  Defense.  In  this  way  the  US  Government  retains  con¬ 
trol  over  the  level  of  activity  and  also  enjoys  price  advantages  due  to 
the  combined  (US  and  foreign)  quantities.  Congress  exercises  its  control 
for  the  customer  program  by  establishing  an  authorization  called  the 
Funded  Reimbursable  Authority  (FRA)  which  is,  in  effect,  a  ceiling  up  to 
which  the  Army  may  award  contracts  for  customers.  In  some  cases  Congress 
and  the  Department  of  State  retain  additional  control  in  the  form  of  a 
final  veto  power,  and  their  written  approvals  must  be  obtained  before  the 
Army  can  award  specific  contracts. 

This  chapter  defines  some  of  the  budgeting  terms  used,  outlines  the 
procedures  by  which  the  Army,  as  agent  for  the  US  Government,  supervises 
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the  purchase  of  military  hardware  by  foreign  countries,  describes  the 
special  labeling  required  to  identify  funds,  and  describes  how  the  data 
were  extracted  and  relabeled  for  the  present  analysis.  Since  this  study  is 
concerned  mostly  with  obligations,  it  will  not  describe  the  various  trust 
funds  used  for  holding  customer  money,  except  to  say  that  customer  funds 
are  not  mixed  with  direct  Army  funds;  and  it  will  not  describe  how  payment 
is  made  to  the  contractor  (expenditures).  The  customer  process  is  much 
more  complex  than  can  be  described  here.  For  example,  some  items  are 
provided  from  the  Army's  current  inventory  and  not  from  a  production  con¬ 
tract.  Depending  on  whether  or  not  the  item  is  obsolete  (to  the  US),  the 
Army  may  or  may  not  rebuy  the  item.  It  is,  of  course,  only  a  contract  that 
constitutes  an  obligation  in  the  budgetary  sense.  More  detail  is  available 
in  the  Military  Assistance  and  Sales  Manual  (MASM). 

B.  THE  CUSTOMER  PROCESS. 

The  acquisition  process  for  the  customer  program  includes  eight  main 
steps,  as  follows: 

1.  The  customer  approaches  the  Army  (specifically,  the  US  Army 
Security  Assistance  Center,  USASAC)  asking  for  information  on  price  and 
availability  or  for  a  specific  offer. 

2.  The  request  is  sent  to  the  appropriate  case  manager  at  the  Major 
Subordinate  Comnand  (MSC)  responsible  for  the  item.  The  case  manager 
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prepares  a  Letter  of  Offer  (Form  1513)  describing  the  name  of  the  item, 
quantities,  schedules  and  a  tentative  price.  The  Letter  of  Offer  is  sent 
to  the  customer  for  signature. 

3.  The  customer  signs  the  document,  now  called  a  Letter  of  Offer  and 
Acceptance  (LOA),  and  returns  it  through  USASAC  to  the  case  manager  at 
the  MSC.  The  returned  LOA,  when  it  is  recorded  by  the  MSC,  constitutes  an 
"order." 

4.  The  case  manager  obtains  any  necessary  approvals  from  Congress  or 
the  Department  of  State. 

5.  The  Army  and  the  American  contractor  decide  on  a  price  for  the 
quantity  required  in  accordance  with  procedures  established  in  the  Defense 
Acquisition  Regulation  (DAR). 

6.  Both  the  contractor  and  the  Army  (Contracting  Officer)  sign  the 
necessary  legal  instrument.  This  can  be  a  new  contract,  a  modification  of 
an  existing  contract,  or  the  exercise  of  an  option  clause  on  an  existing 
contract.  The  signed  agreement  is  a  legal  obligation,  and  when  it  is 
recorded  by  the  MSC,  it  constitutes  an  "obligation”  in  the  budgetary  sense. 

7.  The  hardware  is  delivered  to  the  customer. 

8.  Payment  is  made  to  the  contractor. 

The  Army  uses  five  categories  to  classify  the  orders  and  obligations 
above.  These  categories  are  named:  Procurement  of  Aircraft  (also  known 


as  2031 £  for  the  customer  program),  Procurement  of  Missiles  (2032), 
Procurement  of  Weapons  and  Tracked  Combat  Vehicles  (2033),  Procurement  of 
Ammunition  (2034)  and  Procurement  of  Other  (2035).  Although  Army  appro¬ 
priations  are  not  used  for  the  customer  program,  these  categories  are 
traditionally  called  procurement  appropriations.  They  correspond  to  five 
similarly-named  procurement  appropriations  used  for  direct  Army  requirements. 

Each  of  these  appropriations  has  a  life  of  three  years,  during  which 
new  obligations  can  be  made  against  the  appropriation.  Each  fiscal  year 
Congress  establishes  a  new  set  of  five  appropriations,  so  that  there  is 
always  some  overlapping.  For  example,  at  any  point  in  time  there  are  three 
active  appropriations  called,  "procurement  of  aircraft."  Funds  cannot 
easily  be  transferred  or  reprogrammed  among  the  five  categories  or  among 
the  three  active  years  of  a  single  category.  Depending  on  the  item  the 
approval  level  for  such  a  reprogramming  can  be  the  Office  of  the  Secretary 
of  Defense  or  even  Congress. 

C.  DATA  FOR  ORDERS  AND  OBLIGATIONS. 

The  existence  of  so  many  ( ; 5 )  active  accounts  makes  necessary  a  special 
data  labeling  to  identify  transactions.  Comptroller  offices  traditionally 
describe  the  data  using  an  expression  of  the  form  "7/9A,"  where  the  seven 
and  nine  refer  to  the  first  and  last  active  years  (FY  1977  and  FY  1979, 
respectively,  and  the  letter  (A,  B,  or  C)  designates  which  of  the  three 

2 

The  appropriation  numbers  are  those  used  in  the  "307-21"  report 
described  in  the  next  section. 
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years.  For  example,  September,  7/9A  refers  to  the  month  September  of  1977, 
and  to  the  FY  1977  appropri ation.  September,  7/9B  refers  to  the  month 
September  of  1978,  and  to  the  FY  1977  appropriation,  which  Is  still  active. 
For  purposes  of  the  present  analysis,  the  data  were  relabeled  more  simply, 
by  using  the  fiscal  year  (the  year  first  available),  and  the  number  of 
months  from  the  beginning  of  the  appropriation  (one  through  thirty-six). 

The  two  examples  above  become  FY  77,  month  12  and  FY  77,  month  24, 
respectively.  This  scheme  facilitates  analysis,  because  all  data  relating 
to  month  12,  for  example,  can  be  compared  directly. 

Historical  data  for  orders  and  obligations  were  extracted  from  the 
report  "Status  of  Procurement  Appropriation  Customer  Financial  Plan, 
Schedule  307-21"  prepared  by  the  Army  Finance  and  Accounting  Center.  For 
each  of  the  five  customer  appropriations  the  data  are  further  categorized 
by:  Foreign  Military  Sales  (FMS,  which  covers  sales  to  other  nations 
which  are  providing  their  own  funds).  Military  Assistance  Program  (MAP), 
which  covers  acquisitions  for  nations  which  are  paying  with  grants  provided 
by  Congress),  and  Other  (which  is  used  primarily  when  the  Army  purchases 
items  for  other  US  agencies,  for  example,  ammunition  for  the  US  Air  Force). 
These  data  are  given  in  Appendices  A  through  E. 
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CHAPTER  III 

STATISTICAL  FORECASTING 


A.  INTRODUCTION. 

This  chapter  begins  by  clarifying  the  difference  between  a  forecast 
and  a  goal ,  and  by  describing  some  of  the  adverse  consequences  to  an 
organization  if  its  operations  do  not  reflect  this  difference.  Since 
previous  studies  show  confusion  between  curve  fitting  and  forecasting, 
several  traditional  methods  are  compared,  contrasted  and  evaluated.  Box- 
Oenkins  time  series  analysis  is  described  briefly  and  then  applied  to 
Foreign  Military  Sales  orders  and  obligations.  Finally,  ratio  analysis, 
developed  especially  for  this  study,  is  described  and  applied  to  FMS,  MAP, 
Other,  and  Total  customer  obligations.  This  method  requires  an  independent 
estimate  of  year  end  orders,  but  seems  to  give  reasonably  accurate  forecasts 
for  months  one  through  thirty-six. 

B.  FORECASTING  AND  GOAL  DETERMINATION. 

It  is  essential  to  distinguish  between  a  forecast  and  a  goal  in  order 
to  understand  the  obligation  process.  For  the  purposes  of  this  study  a  goal 
is  a  numerical  target  expressing  what  a  specific  organizational  unit  should 
achieve.  Usually  goals  are  negotiated  between  different  levels  and  they 
reflect  management  decisions  about  what  the  future  value  of  a  variable 
(like  obligations)  should  be.  A  forecast,  on  the  other  hand,  is  an  objective 
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estimate  of  what  the  future  value  of  a  variable  will  be,  If  certain  stated 
assumptions  hold  during  the  forecast  period.  For  example,  we  forecast 
tomorrow's  outside  temperature,  but  our  goal  for  tomorrow's  inside  temper¬ 
ature  (achieved  by  setting  a  thermostat)  is  sixty-five  degrees.  Note  that 
setting  a  thermostat  outside  in  the  winter  will  only  result  in  the  continu¬ 
ous  operation  of  the  furnace.  It  is  impossible  to  achieve  a  goal  for  out¬ 
side  temperature,  and  it  is  unnecessary  to  forecast  the  inside  temperature. 

The  Army  uses  the  aggregated  forecasts  described  above  as  its  goal. 
Although  each  program  estimate  may  reflect  the  best  judgment  available 
as  to  the  amounts  and  timing  of  funds,  there  are  more  events  which  can 
slow  down  the  process  (cancellations,  protests,  strikes,  etc.)  than  can 
speed  it  up.  Thus  the  goal  setting  procedures  may  be  causing  the  Army  to 
start  the  year  with  an  unrealistically  high  goal. 

Another  problem  with  these  goals  might  be  that  they  tend  to  perpetuate 
suboptimal  procedures.  Some  offices  may  have  achieved  their  goals  by  the 
excessive  use  of  overtime  (which  is  sometimes,  but  not  always,  desirable), 
by  emphasizing  the  placement  of  large  dollar-amount  contracts  (while 
smaller,  equally  important  requirements  are  deferred),  by  use  of  letter 
contracts  (usually  judged  less  desirable  than  other  types)  or  by  deferring 
and  cancelling  important  work  such  as  planning  and  review.  Historical 
data  from  such  an  office  would  lead  to  the  conclusion  that  the  same  achieve 
ment  is  possible  again  next  year.  If  this  forecast  were  used  as  a  goal, 
then  the  above  procedures  become  necessary  next  year  (and  every  year)  in 
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order  to  achieve  this  inappropriately  high  goal.  The  present  study  did  not 
collect  data  to  support  or  to  refute  the  occurrence  of  the  practices  above, 
but  they  were  mentioned  by  several  respondents,  and  are  consistent  with  the 
data  which  show  a  large  Increase  in  obligations  during  month  12. 

Figure  1  shows  the  relationship  between  forecasts  and  goals  for  the 
obligation  of  procurement  funds.  Using  historical  data  for  orders  and 
obligations,  and  considering  the  projected  workload  and  available  resources 
to  process  it,  the  MSC's  develop  a  forecast  of  obligations.  After  nego¬ 
tiation  between  the  MSC  and  DARCOM  an  agreement  is  reached  on  an  organiza¬ 
tional  goal.  The  MSC  determines  how  to  implement  this  goal,  and  it 
periodically  reports  its  achievement.  These  reports  are  used  later  to 
update  the  historical  data  base. 

Figure  1  illustrates  two  points  about  forecasting  and  goal  determination. 
If  new  circumstances  arise  during  the  year,  the  original  goal  is  still  the 
target.  Therefore,  in  order  to  achieve  the  goal  under  the  new  circumstances, 
the  MSC's  will  probably  have  to  change  the  method  of  implementation,  for 
example,  by  scheduling  overtime.  Thus,  the  assumptions  (about  resources 
required)  leading  to  the  original  forecast  are  invalidated  later.  The 
achievement  at  the  end  of  the  year  may  not  relate  directly  either  to  the 
original  forecast  or  to  the  goal.  Secondly,  note  that  the  MSC's  original 
forecast  is  used  as  the  starting  point  in  a  negotiation  process.  This  use 
may  affect  the  objectivity  of  the  forecast.  The  present  approach  for  goal 
setting  provides  no  direct  link  (such  as  a  regression  equation)  between  the 


ultimate  value  of  obligations  and  the  resources  and  conditions  required  to 
achieve  these  obligations.  Since  more  things  can  slow  the  process  than 
can  speed  it  up,  the  MSC's  often  find  themselves  in  a  crisis  at  the  end  of 
the  fiscal  year,  trying  to  achieve  the  original  goal. 

Although  this  study  uses  historical  data  for  orders  and  obligations, 
these  data  may  partly  reflect  past  efforts  to  achieve  the  goals  negotiated 
between  different  Army  levels  (HQ  OA,  DARCOM,  and  the  MSC’s),  rather  than 
reflecting  a  purely  statistical  process  in  which  orders  flow  through  the 
system  with  constant  speed,  finally  becoming  obligations.  Any  forecasts 
based  on  historical  Army  data  may  reflect  the  influence  of  goals  on  the 
obligation  process.  However,  the  Arrny  will  probably  continue  to  manage  by 
goals,  so  any  inferences  from  the  data  should  continue  to  apply. 

C.  TRADITIONAL  FORECASTING  METHODS. 

Previous  studies  have  shown  confusion  between  curve  fitting  and  fore¬ 
casting.  It  is  true  that  a  plot  of  cumulative  obligations  against  months 

looks  as  if  it  could  be  fitted  by  some  kind  of  curve.  Even  a  straight 

3 

line  may  give  a  high  index  of  determination  and  small  estimation  errors 
(actual  data  less  fitted  value)  when  fitted  to  historical  data.  However, 
these  fits  are  not  as  valuable  as  they  seem  to  two  reasons.  First,  any 
cumulative  data  will  correlate  highly  with  months  if  the  average  increment 

3  2 

The  index  of  determination  (R  )  measures  the  portion  of  the  total 
variation  about  the  mean  which  is  explained  by  the  curve  or  line. 
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is  positive.  Secondly,  the  shape  and  scale  of  next  year's  curve  will 
probably  be  different  from  the  curve  so  carefully  fitted  to  last  year's 
data.  Every  candidate  forecasting  procedure  should  be  evaluated  on  the 
accuracy  with  which  it  estimates  future  values,  not  historical  values. 

Several  statistical  methods  have  been  used  in  recent  attempts  to  fore¬ 
cast  obligations.  If  ihe  variable  t  represents  time  in  months  from  the 
beginning  of  the  fiscal  year,  then  polynomial  regression  seeks  to  estimate 
obligations  (y)  by  using  powers  of  t.  Thus,  y  =  a  +  b(t)  is  a  straight 
line,  y  =  a  +  b(t)  +  c(t  )  provides  for  curvature,  and  inclusion  of  higher 
power  terms  allows  an  increasing  variety  of  shapes.  Although  historical 
data  for  any  single  year  can  be  fitted  closely,  both  the  shape  of  the 
curve  and  the  end-of-year  amount  vary  widely  from  year  to  year.  Polynomial 
regression  has  not  succeeded  in  previous  Army  forecasting  studies  and  was 
not  explored  further. 

Multiple  regression  seeks  to  estimate  obligations  (y)  by  using  in  one 
equation  several  obligation-driving  variables,  such  as  orders  (x),  time 
(t)  and  any  other  variables  having  a  significant  influence.  Multiple 
regression  is  basically  curve  fitting  in  a  higher  dimensional  space,  and  the 
remarks  above  comparing  curve  fitting  and  forecasting  apply.  There  are  two 
other  objections  to  the  use  of  multiple  regression  for  forecasting  obliga¬ 
tions.  First,  the  sequences  of  orders  and  obligations  may  show  seasonal 
patterns  or  statistical  relationships  between  nearby  values  that  can  be 
used  in  forecasting,  but  which  multiple  regression  ignores.  Second, 
multiple  regression  can  address  the  delay  between  orders  and  obligations 
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in  only  one  way  --  the  use  of  lagged  variables.  There  are  more  efficient 
ways  to  model  these  delays. 

Autoregressive  models  explicitly  address  the  lack  of  independence 
between  consecutive  months.  Denoting  obligations  at  time  t  by  y^  , 
autoregressive  models  use  an  equation  of  the  form: 

h  *  a  *  Vt-I  *  Vt-2  *  b3yt-3  *  •  •  ■  b12yt-12 

Any  dependence  between  values  one,  two  or  more  months  apart  can  be  estimated,  and 
the  necessary  adjustments  can  be  made  to  the  forecast  equation.  Seasonal 
patterns  (a  special  type  of  dependence  between  values  one  budget  cycle 
apart)  can  also  be  handled  with  autoregressive  models.  Autoregressive 
models  actually  are  a  special  case  of  the  Box-Jenkins  time  series  approach, 
which  will  be  discussed  more  fully  in  the  next  section. 

Exponential  smoothing  models  (sometimes  known  as  exponential ly  weighted 
moving  average  models)  seek  to  estimate  obligations  by  using  an  equation  of 
the  form: 

yt  =  (l-b)(yt_1  +  byt_2  +  b2yt_3  +  b3yt_4  +  .  .  .), 

where  b  is  called  the  smoothing  constant.  Exponential  smoothing  has  given 
good  estimates  in  certain  applications,  such  as  in  forecasting  demand  for 
spare  parts.  Box  and  Jenkins  (1976)  show,  however,  that  exponential 
smoothing  gives  the  optimal  forecast  for  only  one  special  situation;  namely, 
what  they  call  the  first  order  integrated  moving  average  process.  Thus, 
the  advantages  of  exponential  smoothing  will  be  obtained  automatically 
using  the  more  general  Box-Jenkins  time  series  approach  described  next. 
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0.  BOX- JENKINS  TIME  SERIES  ANALYSIS. 


1 .  Descri ption . 

This  section  briefly  describes  time  series  analysis  and  its  applica¬ 
tion  to  forecasting  customer  obligations.  The  subject  is  much  more  complex 
than  can  be  described  here,  and  those  interested  in  further  detail  should 
consult  Box  and  Jenkins  (1976)  or  for  a  more  elementary  presentation. 

Nelson  (1973).  Time  series  analysis  in  the  present  context  seeks  to  estimate 
future  values  of  obligations  by  using  historical  values  of  obligations 
(univariate  time  series  analysis),  or  by  using  historical  values  of 
obligations  together  with  historical  values  of  orders  (transfer  function 
analysis).  More  independent  variables  can  be  handled  by  using  multiple  time 
series  analysis,  but  the  present  study  considered  customer  orders  as  the 
main  driving  variable.  The  somewhat  complex  statistical  parts  of  this 
section  are  provided  for  completeness.  Understanding  the  statistical  parts 
is  not  essential  to  follow  the  results  as  they  relate  to  forecasting  obligations. 

2.  Univariate  Analysis  of  Time  Series. 

Univariate  time  series  analysis  models  a  process  such  as  monthly 
obligations  by  expressing  the  value  at  time  t  as  a  function  of  (a)  previous 
values  of  the  process,  (b)  previous  forecasting  errors  and  (c)  a  current 
forecasting  error.  A  model  using  only  previous  values  is  called  an  auto¬ 
regressive  process  as  discussed  in  the  previous  section,  and  a  model  using 
only  previous  forecasting  errors  is  called  a  moving  average  process.  In 
some  cases  (for  example,  when  working  with  cumulative  data)  the  analysis  is 
made  on  the  incremental  differences  from  one  month  to  the  next.  To  recover 
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the  original  series  the  increments  are  summed.  Instead  of  calling  the 
original  series  "summed"  however,  the  customary  word  is  "integrated," 
borrowing  from  the  theory  of  differential  equations  which  are  the  continuous 
analogues  of  time  series.  The  forecast  errors  are  really  unexplained 
deviations  from  the  forecast  and  can  be  interpreted  as  "shocks"  to  the  system. 
Their  effects,  whether  immediate  or  delayed,  can  be  represented  in  the 
moving  average  part  of  the  model.  An  integrated  model  with  one  moving  average 
term  is  the  same  as  an  exponential  smoothing  model.  The  term  ARIITA  refers 
to  a  model  which  potentially  includes  autoregressive  (AR),  integrated  (I), 
and  moving  average  (MA)  terms.  The  point  of  modeling  the  present  value  in 
terms  of  previous  values  and  forecast  errors  is  to  quantify  the  relationship, 
including  any  dependence  between  observations  one,  two,  up  to  about  40 
periods  apart.  If  the  relationship  between  present  and  past  is  stable 
(this  can  be  tested  in  a  long  time  series),  the  same  relationship  should 
hold  between  the  future  and  the  present.  This  allows  forecasting. 

The  identification  of  which  terms  should  be  in  the  model  is  based  on 
a  study  of  the  relationships  between  values  k  periods  apart  for  each  lag  k 
from  one  to  40.  The  strength  of  the  relationship  is  measured  by  the  auto¬ 
correlation  function  (ACF)  and  the  partial  autocorrelation  function  (PACF). 

The  ACF  and  the  PACF  are  analogous  to  correlation  and  partial  correlation 
in  multiple  regression.  The  ACF  at  lag  five,  for  example,  reflects  the 
correlation  between  y^  and  y^,  where  t  ranges  over  all  observations 
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is  missing).  The  PACF  at  lag 


(except  the  first  five,  for  which  yt_^ 
five  reflects  the  correlation  between  yt  and  y^_g  that  is  not  explainable 
by  the  correlation  at  lags  one  through  four.  Thus,  the  PACF  at  lag  five 
helps  determine  whether  to  have  a  fifth  order  term  or  to  stop  at  four 
terms. 

The  identification  process  is  diagramed  in  Figure  2.  If  the  ACF 
declines  very  slowly,  a  new  series  is  calculated  using  the  consecutive 
differences  of  the  original  series.  Cumulative  data  always  requires  this 
step,  called  "differencing."  The  new  series  may  require  differencing 
again.  The  number  of  times  the  differencing  step  is  performed  is  denoted 
usually  by  the  letter  d,  and  if  d  is  one  or  more  the  model  is  called 
"integrated. " 


FIGURE  2 

identification  procfss 


*  INDICATIONS  THAT  DIFFERENCING  IS  REQUIRED  — 
a)  ACF  TAILS  OFF  VERY  SLOWLY 
B)  SERIES  SHOWS  NO  AFFINITY  FOR  A  MEAN  VALUE 
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After  differencing  d  times  the  ACF  is  examined.  If  the  ACF  abruptly 
becomes  statistically  not  significant  after  lag  q,  the  model  is  tentatively 
identified  as  having  q  moving  average  terms,  and  no  autoregressive  terms. 

If  instead,  the  ACF  declines  slowly,  the  PACF  is  examined.  If  the  PACF 
cuts  off  after  lag  p  the  model  is  tentatively  identified  as  having  p 
autoregressive  terms,  and  no  moving  average  terms.  If  instead  the  PACF 
tails  off  (and  the  ACF  tails  off),  the  model  probably  has  both  moving 
average  and  autoregressive  terms.  In  this  case  one  can  compare  the  ACF 
and  PACF  patterns  to  those  of  models  having  known  forms.  A  model  with  p 
autoregressive  terms,  d  stages  of  differencing  and  q  moving  average  terms 
is  called  an  ARIMA  (p,  d,  q)  model. 

For  this  time  series  analysis  FMS  data  were  extracted  for  fiscal 
year  1976  (months  15  through  36),  fiscal  year  1977  (months  1  through  36), 
and  fiscal  year  1978  (months  1  through  21).  FMS  data  were  analyzed 
alone  because  they  should  be  more  homogeneous  than  the  total  (FMS  plus 
MAP  plus  Other),  and  because  FMS  is  the  largest  component.  Data  prior 
to  month  15  of  FY  1976  appeared  to  be  very  unusual ,  and  data  prior  to 
month  eight  were  missing,  so  analysis  started  with  month  15  of  FY  1976. 

Data  after  month  21  of  FY  1978  were  not  yet  available,  so  the  data 
terminated  at  month  21  of  FY  1978.  The  data  from  FY  1979  could  not  be 
joined  at  the  end,  because  there  is  no  way  to  handle  the  missing  values 


from  months  22  through  36  of  FY  1978,  which  will  not  be  available  until 
October  1980.  The  consecutive  differences  were  taken  to  give  obligations 
per  month,  instead  of  cumulative  obligations.  Five  time  series  resulted 
(one  for  each  appropriation)  each  having  79  data  points.  These  are  con¬ 
sidered  adequate  sample  sizes,  since  the  traditional  minimum  sample 
size  required  for  time  series  analysis  is  50  observations. 

Frequency  plots  were  made  of  monthly  obligations  to  determine 
whether  or  not  they  are  normally  distributed  about  a  mean  value.  Obli¬ 
gations  were  found  to  be  heavily  skewed  to  the  right,  meaning  that  there 
are  many  months  in  which  a  small  amount  is  obligated  (sometimes  a  net 
value  is  negative,  reflecting  deobligations)  and  there  are  a  few  months 
in  which  a  very  large  amount  is  obligated  (often  months  in  addition  to 
month  12,  which  is  always  large).  Logarithmic  and  square  root  trans¬ 
formations  were  made  following  Box  and  Cox  (1964),  with  the  square  root 
transformation  making  the  data  much  more  normally  distributed.  Orders 
also  show  a  right-skewed  distribution. 

The  results  of  the  univariate  time  series  analysis  are  as  follows. 

First,  the  ACF's  show  that  a  knowledge  of  recent  historical  obligations 
does  not  contribute  significantly  more  to  a  forecast  than  knowledge  of 
the  monthly  average  value  of  the  series.  Second,  while  taking  square  roots 
makes  the  transformed  obligation  series  more  nearly  normal,  it  does  not 
improve  the  ability  to  forecast.  One  series,  procurement  of  missiles  (2032) 
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showed  a  significant  autocorrelation  function,  but  the  biggest  autocorrela¬ 
tion  was  only  0.40  (at  lag  four),  and  this  is  too  low  for  useful  forecasting. 
If  FMS  obligations  cannot  be  forecasted  from  their  own  history  (other  than 
using  an  average  value),  it  is  worthwhile  to  determine  whether  knowledge 
of  another  related  series,  such  as  customer  orders,  can  help.  This  idea 
is  explored  in  the  next  section. 

3.  Transfer  Function  Analysis. 

Time  series  analysis  with  transfer  functions  seeks  to  represent 
the  value  of  the  dependent  variable  (in  this  case  FMS  obligations)  in  terms 
of  the  previous  history  of  that  variable  and  the  previous  history  of  another, 
independent  variable  (FMS  orders).  The  analysis  is  illustrated  in  Figure  3 

which  shows  two  water  tanks  connected  by  a  long  pipe. 

FIGURE  3 
OBLIGATION  PROCESS 


ORDERS  OBLIGATIONS 


CANCELLATIONS 

NET  ORDERS  ■  ORDERS  -  CANCELLATIONS 


DEOBLIGATIONS 

NET  OBLIGATIONS  - 
OBLIGATIONS  -  DEOBLIGATIONS 


FMS  orders  arrive  at  the  left;  however,  some  orders  are  cancelled, 
leaving  net  orders  which  build  up  in  the  tank  at  the  left.  A  long  pipe 
connects  the  two  tanks  and  after  a  period  of  time  (up  to  five  months  if  the 
Army  has  to  wait  for  approvals  from  the  Department  of  State,  or  accumulate 
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more  FMS  orders)  the  orders  become  obligations,  represented  by  the  tank 
at  the  right.  Not  every  order  becomes  an  obligation,  so  the  obligation 
tank  is  shown  as  smaller.  It  is  possible  to  reduce  the  size  of  a  contract 
or  terminate  it,  so  the  figure  provides  for  deobligations.  Obligations, 

less  deobligations  leave  net  obligations.  Figure  3  reflects  several  aspects 
of  the  obligation  process,  including  the  delay  or  dead  time  before  the 

input  (orders)  has  any  effect  on  the  output  (obligations).  The  spreading 
of  one  month's  input  to  several  output  periods  and  the  inertia  in  the 
output  are  also  reflected  in  this  model.  A  complete  discussion  of  transfer 
function  models  is  in  Box  and  Jenkins  (1976),  and  an  introductory  discussion 
is  given  in  Helmer  and  Johansson  (1977).  A  very  brief  discussion  is  pro¬ 
vided  here. 

The  continuous  model  shown  in  Figure  3  can  be  represented  mathematically 
as  a  differential  equation.  The  analogous  discrete  model  underlying  our 
data  can  be  represented  mathematically  as  a  difference  equation.  The 
general  form  for  such  an  equation  is: 


Yt  -  Vt-1 


...  -d  Y.  =  w  X.  ,  -  w, X.  .  .  -  . . .  -w  X.  . 

r  t-r  o  t-b  1  t-b-1  s  t-b-s 


where 


FMS  obligations  during  month  t. 


=  FMS  orders  during  month  t, 

d..  =  Output  lag  coefficients,  to  be  estimated  from  the  data, 

w.  =  Input  lag  coefficients,  to  be  estimated  from  the  data, 
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b  =  Number  of  months  of  delay  before  any  effect  of  an  order 
can  be  seen  in  the  obligation  series. 

The  above  equation  relating  Y  and  its  history  to  X  and  its  history  is 

called  a  "transfer  function"  model,  because  it  can  be  used  to  express  the 

way  variations  in  the  input  series  are  transferred  into  variations  in  the 
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output  series.  The  delay  between  X  and  Y  is  reflected  by  the  subscript  b 
which  shifts  the  comparison  backwards  in  time.  The  w's  reflect  the  more 
immediate  effects  of  X  on  Y,  and  reach  back  s  periods.  The  d's  reflect 
any  inertia,  or  gradual  decay  of  the  effect,  and  reach  back  r  periods. 

In  univariabe  time  series  analysis,  the  model  was  identified  by  using 
the  autocorrelation  function.  In  transfer  function  analysis  the  model  is 
identified  by  using  the  cross  correlation  function  (CCF)  which,  for  each  lag 
k,  measures  the  relationship  between  obligations  during  month  t  and  orders 
during  month  (t-k).  Based  on  patterns  observed  in  the  CCF  a  tentative  model 
is  defined  (b,  r,  and  s  are  selected),  coefficients  are  estimated  (the 
d's  and  the  w's  in  the  equation),  and  the  results  are  analyzed  for  possible 
problems.  If  the  input  series  is  completely  random,  or  a  "white  noise" 
series,  the  CCF  will  reflect  the  underlying  model.  Otherwise,  it  first 
must  be  "prewhitened,"  a  process  in  which  a  transformation  is  applied  to  the 
input  series  to  make  it  random.  The  same  transformation  is  also  applied  to 
the  output  series,  and  a  new  CCF  is  calculated  which  more  clearly  reflects 
the  underlying  relationship  between  the  two  series.  Prewhitening  was  done 
in  the  present  analysis. 

The  results  of  a  transfer  function  analysis  on  each  of  the  five  FMS  series 
are  as  follows.  The  CCF's  for  Procurement  of  Aircraft  (2031)  and  Procurement 
of  Ammunition  (2034)  are  not  statistically  significant  based  on  a  Chi-square 
test  of  the  first  40  coefficients.  This  means  that  a  knowledge  of  the 
timing  of  specific  orders  does  not  help  forecasting  any  more  than  knowledge 
of  the  average  level  of  the  obligation  process. 
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A  careful  distinction  should  be  made  here.  When  the  CCF  is  statistically 
not  significant,  one  cannot  predict  the  timing  of  specific  obligations  from 
the  timing  of  specific  orders.  However,  years  having  larger  dollar  amounts 
of  orders  still  will  have  larger  dollar  amounts  of  obligations  at  the  end 
of  the  year.  If  the  time  phased  pattern  of  obligations  (as  opposed  to  the 
end  of  year  amount)  is  not  driven  by  the  pattern  of  orders,  perhaps  it 
follows  some  other  typical  pattern.  This  idea  is  explored  further  below 
under  ratio  analysis. 

The  CCF  for  Procurement  of  Missiles  (2032)  does  have  overall  significance 
at  the  95  percent  level  with  the  largest  single  cross  correlation  coefficient 
(.63)  at  lag  one  month.  This  suggests  that,  For  Procurement  of  Missiles, 
the  delay  between  customer  orders  and  their  final  obligation  may  often  be 
about  one  month.  Considering  the  number  of  steps  in  the  obligation  process, 
as  described  in  Chapter  II,  these  orders  are  being  put  on  contract  very 
fast. 

There  are  several  possible  explanations  for  the  r.,ort  lag.  Army  items 
funded  from  2032  often  are  produced  by  a  single  contractor,  already  under 
contract,  and  in  production.  A  competitive  contract  may  have  been  awarded 
recently,  or  competition  may  not  be  feasible  (especially  for  a  small 
customer  increment).  In  this  situation  a  simple  contract  modification  or 
the  use  of  an  option  clause  would  result  in  a  quick  obligation  of  funds. 


Any  approvals  required  from  the  State  Department  or  the  Office  of  the 
Secretary  of  Defense  may  have  been  arranged  in  advance.  Another  possibility 
is  that  offices  which  obligate  2032  funds  are  exceptionally  well  organized. 
Or  they  may  delay  entering  customer  orders  into  the  307-21  reports.  In 
any  case,  the  correlation  between  obligations  at  time  t  and  orders  at  time 
(t-1)  is  much  stronger  than  the  correlation  at  other  lags  for  Procurement 
of  Missiles. 

Calculation  of  the  transfer  function  model  for  Missiles  shows  a 
medium-sized  term  at  lag  one  month,  and  several  small  terms  at  longer  lags. 
This  suggests  the  possibility  of  forecasting  one  month  ahead,  which  would 
be  of  very  limited  value  in  the  present  context.  The  long  range  30  month 
forecast  of  obligations  would  require  a  29  month  forecast  of  orders;  yet 
a  univariate  analysis  of  orders  shows  they  are  not  forecastable  with  time 
series  methods.  However,  if  a  method  for  forecasting  customer  orders 
becomes  available  (perhaps  by  polling  likely  customers),  the  use  of  transfer 
functions  is  worthy  of  further  consideration  for  forecasting  obligations  of 
Procurement  of  Missiles. 

The  CCF  for  Procurement  of  Weapons  and  Tracked  Combat  Vehicles  (2033) 
is  significant  at  the  95  percent  level,  but  the  largest  cross  correlation 
(at  lag  five  months)  is  only  .38.  Many  orders  funded  from  2033  take  five 
months  to  become  obligations.  Calculation  of  the  transfer  function  model 
shows  that  only  the  coefficient  at  lag  five  is  significant.  However,  it 
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is  just  barely  significant  at  the  95  percent  level,  and  its  value  of  .23 
explains  only  a  small  portion  of  the  obligations  of  this  appropriation. 
Inspection  of  the  forecasts  with  one  month  lead  times  showed  an  inability 
to  estimate  accurately  those  months  with  unusually  large  obligations,  such 
as  month  12.  The  use  of  transfer  functions  does  not  seem  promising  for 
forecasting  obligations  of  Procurement  of  Weapons  and  Tracked  Combat  Vehicles. 

The  CCP  for  Procurement  of  Ammunition  (2034)  is  not  significant  at  the 
95  percent  level  of  confidence.  For  this  appropriation  the  best  forecast 
of  obligations  seems  to  be  simply  their  average  level,  perhaps  adjusted 
for  historical  variations  from  month  to  month.  Apparently,  better  knowledge 
of  the  timing  of  orders  for  ammunition  will  not  contribute  more  to  a  forecast 
than  knowledge  of  the  average  level  of  the  obligation  process. 

The  CCF  for  Procurement  of  Other  (2035)  is  significant,  but  the  only 
significant  cross  correlation  is  at  lag  one  month  (.47).  The  discussion 
under  Procurement  of  Missiles  (2032)  about  a  forecast  with  a  one  month 
lead  time  applies  also  to  2035.  For  this  appropriation,  the  use  of  transfer 
functions  would  be  useful  only  if  a  good  long  range  forecast  of  orders  was 
available.  Orders  for  this  appropriation  appear  to  be  random,  so  the 
forecast  of  orders  would  have  to  be  based  on  methods  other  than  time  series 
analysis. 

Time  series  analysis  has  produced  generally  disappointing  results  in 
the  present  application.  Only  Procurement  of  Missiles  and  Procurement  of 
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Other  seem  to  be  forecastable,  given  a  time  phased  forecast  of  orders,  and 
the  forecast  lead  time  for  these  would  be  only  one  month.  Orders  are 
not  forecastable  using  time  series  methods.  The  most  likely  lag  between 
orders  and  obligations  can  be  determined  for  appropriations  2032,  2033, 
and  2035.  The  lags  are  respectively,  one  month,  five  months  and  one  month. 
Monthly  orders  and  monthly  obligations  both  have  distributions  heavily 
skewed  to  the  right;  that  is,  there  are  a  few  very  large  months  and  many 
relatively  small  months.  The  square  root  transformation  makes  the  data 
much  more  normally  distributed,  but  does  not  improve  forecasting.  The 
implications  of  these  findings  are  discussed  in  Chapter  V. 

E.  RATIO  ANALYSIS  OF  CUMULATIVE  ORDERS  AND  OBLIGATIONS. 

1 .  Methodology. 

Transfer  function  analysis  explored  the  idea  that  the  high  points 
and  low  points  of  one  series  (orders)  could  be  used  to  forecast  the  highs 
and  lows  of  another  series  (obligations).  In  a  sense,  it  was  based  on 
a  comparison  of  the  shapes  of  the  orders  and  obligations  series.  The  re¬ 
lationship  between  the  two  shapes  was  found  to  be  weak  for  most  appropriations. 

This  section  will  explore  the  possibility  that  there  nay  be  a 
typical  shape  for  an  obligation  series,  this  shape  being  repeated  from  one 
budget  cycle  to  the  next,  perhaps  with  minor  variations.  Since  some  years 
are  larger  than  others,  a  size-free  comparison  requires  that  all  amounts 
be  expressed  as  ratios,  using  a  selected  base.  Orders  also  will  be 
analyzed  using  the  same  methods. 
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Data  for  this  analysis  were  extracted  from  the  report,  "Status  of  Pro¬ 
curement  Appropriation  Customer  Financial  Plan,"  (the  307-21  report)  as 
described  in  Chapter  II  (C),  and  reflect  actual  (as  opposed  to  planned) 
amounts  ordered  and  obligated.  For  each  of  the  five  procurement  appropria¬ 
tions  cumulative  dollar  amounts  were  recorded  separately  for  orders  (FMS, 
MAP,  Other,  and  Total)  and  obligations  (FMS,  MAP,  Other  and  Total).  This 
data  is  presented  in  Appendices  A  through  E. 

For  each  fiscal  year  the  orders  series  were  standardized  by  dividing 
the  dollar  figure  for  each  month  by  the  base;  namely,  cumulative  orders 
in  month  12.  Of  course,  FMS,  MAP,  Other  and  Total  have  different  bases, 
as  do  different  appropriations.  Thus,  the  amount  of  FMS  orders  for  FY  1978, 
month  six.  Procurement  of  Aircraft  was  expressed  as  .672,  and  the  amount 
for  month  19  as  1.012  (see  Appendix  A).  In  this  way  the  dollar  figures  for 
orders  were  converted  to  ratios,  with  the  orders  for  month  12  always  having 
a  value  of  1.000.  This  procedure  permits  a  comparison  to  be  made  of  the 
shapes  of  the  orders  series. 

Each  obligation  series  was  standardized  using  a  similar  process.  The 
base  for  the  obligation  series  was  defined  as  cumulative  month  12  orders , 
and  not  obligations,  for  two  reasons.  First,  orders  at  month  12  are  more 
readily  determined  in  advance  than  obligations  (if  one  knew  obligations 
at  month  12  he  would  be  finished).  Second,  if  obligations  can  be  estimated 
with  ratios,  these  ratios  logically  will  be  based  on  orders.  For  each  of 
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the  five  procurement  appropriations  the  monthly  ratios  were  calculated  for 
orders  (FMS,  MAP,  Other  and  Total),  and  obligations  (same  breakout).  For 
each  month  several  ratios  occur  —  one  for  each  fiscal  year.  For  example, 
for  month  12,  Procurement  of  Aircraft  (Total),  Fiscal  Year  1976  the  cumulative 
orders  in  thousands  were  $161,722  (see  Appendix  A,  page  4).  This  is  the 
base.  The  corresponding  obligations  were  $115,075,  giving  a  ratio  of  0.712. 

Thus,  approximately  71  percent  of  that  year's  orders  were  obligated  by  the 
end  of  the  year.  Ratios  were  calculated  for  other  fiscal  years  and  the 
average  of  these,  0.706,  is  called  the  "factor"  for  month  12. 

A  graph  of  these  factors  (Appendix  A,  page  12)  shows  that  the  shape 
of  the  obligation  series  is  similar  from  one  budget  cycle  to  the  next. 

The  degree  of  similarity  is  measured  by  the  standard  deviation  of  these 
factors.  Table  1  gives  factors  and  95  percent  confidence  limits  (two 
standard  deviations)  for  total  end  of  year  obligations  (FMS  plus  MAP 
plus  Other)  for  each  appropriation.  Other  factors  and  standard  deviations 
are  given  in  the  appendices. 

2.  Application  of  Ratio  Analysis  to  Forecasting. 

The  graphs  show  and  the  standard  deviation  columns  confirm  that  the 
shapes  of  the  curves  are  indeed  similar  from  year  to  year.  This  allows 

obligations  to  be  forecasted  given  an  estimate  of  cumulative  orders  through  , 

J  } 

the  end  of  month  12.  The  estimated  orders  times  the  factor  for  month  i 
(i  =  1,2,. ..,36),  is  the  obligation  forecast  for  month  i.  The  standard 
deviations  allow  confidence  intervals  to  be  made,  assuming  a  firm  estimate 
of  orders  is  available. 

I 
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T'^LE  1 

END  OF  YEAR  OBLIGATIONS  COMPARED  TO  END  OF  YEAR  ORDERS 


FACTOR 

TWO  STANDARD  DEVIATIONS 
(95%  CONFIDENCE) 

Procurement  of  Aircraft 

.71 

+  .08 

Procurement  of  Missiles 

.84 

+  .16 

Procurement  of  Weapons  4  T.C.V. 

.77 

+  .24 

Procurement  of  Ammunition 

.64 

+  .38 

Procurement  of  Other 

.67 

+  .16 

The  confidence  limits  above  reflect  a  "best  case,"  in  which  end-of-year 
orders  are  exactly  known.  Ratio  analysis  shows  that  orders  do  not  follow 
a  stable  pattern  from  year  to  year,  however,  so  it  is  not  possible  to 
estimate  the  end  of  year  orders  accurately  using,  say,  orders  at  month  six 
together  with  a  historical  factor.  Thus,  actual  forecasting  accuracy  is 
less  than  that  implied  by  the  appendices. 

The  problem,  of  course,  is  that  orders  are  not  exactly  known.  They  are 
however,  estimated  by  the  MSCs  using  nonstatistical  methods.  Although  the 
MSC  projections  of  orders  are  not  always  exact,  they  could  be  used  with  the 
factors  developed  here  to  provide  an  indeper  .*nt  DARCOM  obligation  forecast 
The  MSCs  also  could  use  the  factors  to  deU  mine  whether  or  not  their  own 
obligation  forecasts  were  realistic. 
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Ratio  analysis  suggests  that  efforts  to  improve  forecasting  should  be 
directed  at  making  better  forecasts  of  orders  (perhaps  by  polling  customers 
or  developing  customer  profiles).  It  also  suggests  that  statistical  methods 
can  give  only  approximate  obligation  forecasts,  even  if  orders  are  exactly 
known. 

This  chapter  began  by  distinguishing  between  goal  determination  and 
forecasting.  Several  curve  fitting  methods  were  described,  including  poly¬ 
nomial  regression  and  multiple  regression.  Time  series  methods  were  used, 
but  the  timing  of  orders  did  not  seem  to  drive  the  timing  of  obligations. 
Time  series  methods  did  not  provide  good  forecasts  of  obligations.  Ratio 
analysis  described  the  typical  monthly  patterns  followed  by  orders  and 
obligations,  but  its  use  in  forecasting  required  an  outside  estimate  of 
year  end  orders.  The  analysis  here  suggests  that  the  obligation  process 
does  not  permit  accurate  statistical  forecasting. 

An  accurate  forecast  is  still  required.  If  a  statistical  model  cannot 
fully  describe  the  relationship  between  orders  and  obligations,  perhaps 
other  factors  are  at  work.  The  next  chapter  will  explore  some  of  the 
organizational  and  behavioral  elements  which  may  explain  the  statistical 
findings  of  this  chapter. 
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CHAPTER  IV 


OTHER  INFLUENCING  FACTORS 


A.  INTRODUCTION. 

The  statistical  models  in  Chapter  III  were  not  able  to  explain  fully  the 
obligation  process.  This  process  possibly  violates  some  of  the  assumptions 
underlying  the  models.  For  example,  time  series  and  multiple  regression 
both  assume  the  average  lag  between  orders  and  obligations  is  constant 
throughout  the  year.  However,  the  velocity  of  paperwork  through  the  system 
may  be  slower  at  the  beginning  of  the  year  and  faster  at  the  end.  The 
violation  of  assumptions  would  defeat  time  series  analysis  and  multiple 
regression. 

This  chapter  considers  several  factors  which  could  influence  the 
speed  with  which  orders  become  obligations.  The  obligation  process  will  be 
viewed  as  reflecting  a  complex  system  involving  many  parties  and  multiple 
goals.  The  chapter  will  consider  how  the  interaction  of  these  parties  with 
each  other  and  with  their  external  environment  can  influence  the  obligation 
process.  It  suggests  that  some  important  nonstatistical  factors  are  present, 
and  may,  in  fact,  dominate  the  statistical  phenomena  occurring.  The 
relevance  of  these  factors  to  forecasting  obligations  will  be  discussed, 
together  with  implications  for  the  larger  acquisition  process. 
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B.  GOALS,  PARTIES,  AND  INTERACTIONS. 

Organizational  theorists,  such  as  Eisenstadt  (1956)  and  Lorsch  and 
Lawrence  (1972)  say  any  organization  (for  example,  DARCOM,  an  MSC,  or  a 
single  procurement  office)  can  be  described  usefully  as  a  complex  system 
having  many  parties  and  multiple  goals.  In  the  present  context  goals  can 
be  classified  as  major,  subsidiary,  procedural,  and  social.  For  example, 
DARCOM's  major  defense  goals  include  the  acquisition  of  hardware  and  the 
preservation  of  the  mobilization  base.  Each  organizational  level  has 
subsidiary  objectives  in  support  of  the  major  goals,  for  example,  obligation 
rates  and  processing  time  for  orders.  The  system  has  incentives  for  the 
achievement  of  these  objectives,  as  well  as  sanctions  for  not  achieving  them. 
Procedural  goals  refer  to  how  things  should  be  done,  rather  than  what  is  to 
be  done.  For  example,  the  Arny  prefers  competitive  contract  awards  even 
though  other  methods  are  faster.  Social  goals  refer  to  considerations  for 
special  groups  (for  example,  small  business  set  asides),  or  for  the  general 
public  (environmental  constraints). 

Each  organizational  unit  or  party  comes  into  being  as  a  means  of  imple¬ 
menting  certain  goals.  In  the  Army  different  units  have  been  created  to 
represent  different  aspects  of  Army  goals.  The  US  Army  Training  and  Doctrine 
Command  (TRADOC)  represents  the  needs  of  the  equipment  users.  The  Logistics 
Evaluation  Agency  (LEA)  insures  that  the  equipment  is  supportable  in  the 
field.  DARCOM  serves  as  the  acquisition  manager. 

Within  DARCOM  different  offices  accomplish  different  subsidiary  or  pro¬ 
cedural  goals.  Thus,  the  Pronram  or  Project  Manager  (PM)  is  responsible  for 
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acquiring  the  hardware,  but  the  Contracting  Officer  (CO)  is  responsible 
for  dealing  evenhandedly  with  defense  corporations  and  following  the 
procedures  prescribed  by  the  Defense  Acquisition  Regulation.  The  Special 
Assistant  for  Small  Business  at  DARCOM  promotes  this  social  goal. 

Different  groups  within  any  unit  will  have  different  conceptions  of 
and  attitudes  toward  the  unit's  multiple  goals.  For  example,  a  PM  and  a 
CO  may  disagree  over  whether  or  not  to  satisfy  an  urgent  military  require¬ 
ment  by  awarding  a  sole  source  contract.  The  PM,  fearing  his  schedule  will 
slip,  and  the  troops  will  become  vulnerable  to  some  new  countermeasure,  may 
feel  justified  in  insisting  on  a  quick  sole-source  award  to  a  known  reliable 
contractor.  The  CO,  fearing  a  legal  protest  from  one  of  the  contractors 
not  selected,  and  the  possibility  of  court  action  resulting  in  a  judgement 
to  repeat  the  whole  award  process,  may  insist  on  a  more  deliberate  award 
process,  such  as  formal  advertising.  Each  party  recognizes  both  goals,  but 
each  looks  first  to  a  different  threat  in  the  environment.  Organizational 
theory  calls  attention  to  the  presence  of  multiple  goals,  and  emphasizes 
that  the  different  attitudes  toward  these  goals  must  be  considered  to 
understand  why  an  organization  functions  the  way  it  does. 

Each  organizational  unit  competes  with  other  units  for  resources, 
authority,  clients  and  protectors.  Therefore,  a  unit  depends  on  its 
environment  and  is  subject  to  pressures.  To  succeed,  an  organization  must 
interact  successfully  with  its  parent  unit,  its  subordinate  elements,  and 
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with  other  groups  which  assist  or  serve  as  checks  and  balances.  Budget 
and  procurement  offices  are  the  focus  of  many  pressures,  simply  because 
they  function  as  keepers  and  distributors  of  resources. 

C.  INFLUENCE  ON  OBLIGATIONS. 

The  pressures  in  the  system  Influence  how  and  when  funds  are  obligated. 
The  targets  for  high  obligation  rates  and  short  processing  times  reflect 
pressures  which  accelerate  the  process.  The  procedural  goals  and  the 
division  of  authority  among  several  offices  tend  to  delay  the  process. 

In  the  example  above,  the  PM's  solution  of  a  sole-source  award  could 
result  in  the  obligation  of  funds  within  the  day.  If  the  CO  insisted  on  a 
lengthy  procedure  such  as  competitive  negotiation  with  formal  source 
selection,  the  funds  might  not  be  obligated  for  many  months.  The  CO  may 
find  it  harder  to  resist  the  PM's  arguments  at  the  end  of  the  year,  if  his 
obligations  were  behind  schedule.  Thus,  the  lag  between  orders  and  obliga¬ 
tions  may  be  shorter  at  year  end. 

Figure  4  shows  some  of  the  parties  involved  in  the  obligation  process 
and  some  of  their  goals.  Note  that  any  proposed  change  to  the  process  can 
be  analyzed  in  terms  of  the  reactions  of  each  party.  For  example,  a  new, 
streamlined  method  of  contracting  may  be  seen  by  some  as  cutting  red  tape, 
but  seen  by  others  as  giving  cocnnanders  a  license  to  abuse  the  system.  Even 
the  goal  of  an  increased  obligation  rate  may  be  opposed  by  some  members  of 
Congress  and  by  some  segments  of  the  public  who  oppose  the  specific  systems 
being  acquired  or  the  general  level  of  foreign  arms  sales. 
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FIGURE  4 


MUI.TIPLL  PART  ITS  AND  GOALS 
IN  THE  OBLIGATION  OE  CUSTOMER  FUNDS 
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Fiqure  4  also  suggests  why  the  obligation  process  is  so  hard  to  change. 
If  the  system  is  in  equilibrium,  then  any  major  change  will  disturb  this 
equilibrium.  Depending  on  how  the  change  affects  achievement  of  various 
goals,  some  parties  will  want  to  implement  it,  but  others  will  want  to  block 
or  redirect  it. 

This  chapter  has  suggested  that  the  obligation  process  reflects 
a  system  with  many  parties  and  multiple  goals.  The  variable  speed  with 
which  the  system  moves  toward  achieving  these  goals  results  from  the  inter¬ 
action  between  the  parties,  each  with  its  own  attitudes  toward  the  multiple 
goals.  Sometimes,  for  example,  at  year  end,  the  pressures  to  accelerate  the 
process  are  strong,  but  at  other  times  this  pressure  is  reduced.  The 
resolution  of  differences  between  the  parties  takes  time  even  under  the 
best  conditions,  and  each  party  is  capable  of  reducing  the  obligation  rate 
when  its  goals  are  not  being  met. 

The  interactions  lead  to  pressures  to  achieve  the  targets,  and  these 
pressures  may  overwhelm  the  purely  statistical  relationships  occurring. 

In  particular,  the  existence  of  a  lag  which  shortens  as  year  end  approaches 
could  account  for  the  weak  forecasting  ability  of  time  series  analysis. 

It  could  also  account  for  the  increasing  slopes  and  year  end  peaks  seen 
in  the  cumulative  obligation  curves  in  the  appendices. 

It  is  always  difficult  to  explain  why  something  does  not  correlate,  and 
organizational  theory  may  not  be  the  only  explanation.  However,  it  serves 
to  explain  part  of  the  process  and  account  for  the  statistical  findings. 
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The  organizational  factors  are  relevant  to  forecasting  If  the  process 
is,  in  fact,  not  primarily  statistical,  but  goal  seeking,  then  accurate 
statistical  forecasting  may  not  be  possible,  even  with  an  accurate  forecast 
of  orders.  Historical  factors  (as  developed  under  ratio  analysis.  Chapter  III) 
may  give  the  best  forecast  because  they  reflect  the  historical  resolution 
of  the  different  pressures  within  the  system. 

It  is  not  clear,  however,  that  past  goals  were  the  most  appropriate 
ones  that  could  have  been  chosen.  It  seems  very  possible  that  better  goal 
determination  (as  opposed  to  better  forecasting)  would  improve  the  acqui¬ 
sition  process.  Improving  goal  determination  is  clearly  beyond  the  scope 
of  the  present  study,  but  the  analysis  of  this  chapter  suggests  that  it 
is  not  something  a  single  MSC,  or  even  DARCOM  can  do  alone.  Each  unit 
(HQ  DA,  DARCOM,  and  the  MSC)  must  consider  the  other  groups  (superior, 
subordinate,  and  lateral)  which  interact  with  it. 


CHAPTER  V 


FINDINGS,  CONCLUSIONS,  AND  RECOMMENDATIONS 


A.  FINDINGS. 

This  study  has  described  the  customer  obligation  process  and  analyzed 
the  data  for  orders  and  obligations  using  several  statistical  techniques. 
Several  findings  can  be  summarized. 

1.  The  relationship  between  the  timing  of  orders  and  the  timing  of 
obligations  is  too  weak  to  yield  accurate  time  phased  obligation  fore¬ 
casts,  even  if  an  accurate  forecast  of  orders  were  available.  For  the 
Procurement  of  Missiles  and  the  Procurement  of  Other  appropriations  the 
relationship  is  statistical ly  significant,  but  not  strong.  A  Box-Jenkins 
transfer  function  analysis  shows  that  the  timing  of  orders  does  not  drive 
the  timing  of  obligations. 

2.  Neither  orders  nor  obligations  can  be  forecasted  from  their  own 
history.  This  expected  finding  was  confirmed  by  a  univariate  time  series 
analysis. 

3.  The  most  likely  lag  between  orders  and  obligations  is  quantified 
for  Procurement  of  Missiles  (one  month),  Procurement  of  Weapons  and  Tracked 
Combat  Vehicles  (five  months),  and  Procurement  of  Other  (one  month).  The 
lags  for  Procurement  of  Aircraft  and  Procurement  of  Other  could  not  be 
quantified  with  aggregated  data,  but  a  sampling  of  transactions  might 
permit  estimation  of  this  lag. 

4.  Monthly  orders  and  monthly  obligations  both  have  distributions 
skewed  heavily  to  the  right;  that  is,  there  are  a  few  very  large  months  and 
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many  relatively  small  months.  The  square  root  transformation  makes  the 
data  much  more  normally  distributed. 

5.  Although  the  timing  of  orders  does  not  drive  the  timing  of  obliga¬ 
tions,  the  amount  of  orders  at  year  end  does  influence  the  amount  of 
obligations.  Further,  the  shapes  of  the  cumulative  obligation  curves  are 
similar  from  year  to  year.  Therefore,  given  an  estimate  of  year-end  orders, 
a  time  phased  obligation  forecast  can  be  made.  Factors  for  use  in  making 
these  forecasts  (including  confidence  limits)  are  provided  for  all  five 
procurement  appropriations  for  FMS,  MAP,  Other  and  Total.  These  forecasts, 
if  based  on  a  firm  estimate  of  orders,  are  especially  accurate  for  Pro¬ 
curement  of  Aircraft  and  Procurement  of  Other. 

6.  Statistical  methods  alone  cannot  provide  accurate  obligation  fore¬ 
casts.  The  organizational  and  behavioral  aspects  of  the  process  also  must 
be  considered. 

B.  CONCLUSIONS. 

Several  conclusions  can  be  drawn  from  the  findings  above. 

1.  The  Array's  present  method,  in  which  the  total  forecast  is  an 
aggregation  of  forecasts  for  individual  customer  orders  and  obligations,  seems 
to  be  as  good  as  any  statistically-based  forecast.  In  particular,  time 
series  methods  (both  univariate  and  transfer  function  analysis)  cannot  provide 
accurate  forecasts  of  customer  obi  igations  for  the  procurement  appropriations. 

2.  The  timing  of  requirements  is  better  known  for  the  direct  Army 
program,  and  statistical  methods  might  permit  good  forecasting  for  some 
appropriations.  However,  for  the  Direct  Arniy  program  the  current  obligation 
forecast  is  more  accurate  than  the  forecast  for  the  customer  program,  and 


it  is  not  known  whether  time  series  methods  would  be  superior  to  the 
present  methods.  In  view  of  the  cost  of  collecting  data  and  the  results 
for  the  customer  program,  it  does  not  seem  promising  to  use  statistical 
methods  for  the  direct  Army  program. 

3.  The  sample  size  of  79  pairs  of  data  points  for  each  appropriation 
was  adequate  for  the  time  series  analysis.  If  more  data  become  available, 
the  autocorrelation  functions  and  the  cross  correlation  functions  can  be 
more  accurately  determined  (for  example,  from  .3  to  .3192  at  laq  k),  but 
the  underlying  relationships  probably  will  not  go  from  not  significant  to 
significant.  There  would  be  little  advantage,  then,  to  repeating  this 
analysis  at  the  end  of  the  current  year  with  more  data. 

4.  Other  forecasting  methods,  such  as  multiple  regression,  polynomial 
regression,  autoregressive  models  and  exponential  smoothing,  which  are 
based  on  either  curve  fitting  or  are  based  on  analysis  of  the  time-phased 
relationships  between  orders  and  obligations,  are  not  promising,  for 
reasons  discussed  in  the  study.  A  sampling  approach,  in  which  individual 
orders  were  followed  through  the  system,  has  been  attempted  by  another 
office,  but  suitable  data  could  not  be  found  and  so  no  conclusions  are 
made  about  the  value  of  that  method. 

5.  An  improved  ability  to  forecast  the  few  large  orders  and  obliga¬ 
tions  would  permit  better  forecasting  of  the  total. 
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6.  Non-statistical  factors  are  influencing  the  obligation  process, 
and  may  in  fact  dominate  it.  The  obligation  process  was  described  as 
reflecting  a  complex  system  having  many  participants  and  multiple  goals. 

The  data  can  be  viewed  as  reflecting  the  motion  of  this  system  toward  its 
numerical  obligation  goals,  rather  than  reflecting  a  statistical  process. 

If  this  viewpoint  is  correct  (and  it  cannot  be  proven),  then  improvements 
will  follow  more  directly  from  changing  the  goal -determination  process 
(between  HQ  DA,  DARCOM,  and  the  MSC's),  than  from  better  statistical 
forecasting. 

C.  RECOMMENDATIONS. 

Several  recommendations  are  made  as  follows: 

1.  Until  a  better  method  is  found  the  Army  should  continue  to  refine 
and  use  its  present  methods  to  forecast  customer  obligations.  Forecasts 
based  on  historical  factors  (ratio  analysis)  should  be  used  by  DARCOM  and 
the  MSC's  to  give  an  independent  estimate  and  to  judge  the  realism  of  the 
traditional  forecasts. 

2.  The  MSC's  should  emphasize  forecasting  customer  orders  on  the  basis 
of  i nformation  peculiar  to  the  customers.  They  should  consider  developing 
profiles  of  customer  behavior  (such  as  cancellation  rates),  surveys  of 
customer  buying  intentions,  and  the  intensive  tracking  of  large  orders 
through  the  system. 

3.  Because  the  statistical  relationship  between  aggregated  orders 
and  obligations  is  so  weak,  no  further  parametric  forecasting  efforts 
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should  be  made  for  customer  obligations.  Consideration  should  be  given 
to  developing  factors  and  rates,  based  on  samples  of  individual  cases. 

4.  Because  of  the  cost  of  collecting  and  analyzing  data,  and  because 
of  the  weak  relationships  found  in  the  customer  program,  statistical  fore¬ 
casting  as  applied  here  should  not  be  attempted  for  the  direct  Army  program. 

5.  Efforts  should  be  made  to  improve  the  process  by  which  HQ  DA, 

DARCOM,  and  the  MSC's  set  obligation  goals.  These  efforts  should  involve 
determining  the  linkage  between  methods  and  resources  used,  and  obligation 
achievement.  They  also  should  consider  the  organizational  factors 
influencing  the  obligation  process. 

6.  This  report  considers  for  the  first  time  the  statistical,  organi¬ 
zational,  and  behavioral  factors  influencing  the  obligation  of  customer 
funds.  Any  future  attempts  to  improve  forecasting  or  goal  determination 
also  should  consider  the  implications  of  the  nonstatistical  factors. 
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cjmulative  from  inception. 
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h^OCUREmENT  Of  MISSIVES 
OTHER  ORDERS.  IN  THOUSANDS 
cumulative  from  inception. 
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and  analyzed.  A  Box-Jenkins  analysis  shows  that  the  timing  of  orders  does  not  drive 
the  timing  of  obligations  and  that  orders  cannot  be  used  to  give  time  phased 
statistical  forecasts.  However,  the  amount  of  year  end  orders  does  influence  the 
amount  of  year  end  obligations  and  the  patterns  are  similar  from  year  to  year.  These 
facts  allow  forecasts  to  be  made.  Organizational  considerations  seem  to  be  influencing 
the  process.  Other  findings,  conclusions  and  recommendations  are  provided  in  the 
study. 
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